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Abstract 



The paper addresses the stabilization of nonlinear systems with semi- 
quadratic cost: quadratic with respect to controls and nonlinear for state 
variables. Paper presents the effective new feedback synthesis procedure. 
The novel feedback design procedure is based on the ideas borrowed from 
nonlinear optics and the theory of semi-classical asymptotics. 

1 Introduction 

Stabilization is one of the central topics of control theory. Moreover, in numerous 
applications of control theory one needs not only to stabilize a nonlinear system 
but also to minimize a certain cost function (like, for example, energy cost). 
These type of problems is well-known in linear system theory and the solution 
can be found in the class of linear feedbacks [12]. It is also closely related to 
-ffoo-control theory [13j . The nonlinear generalization of theory is presented 
in [TT]. This paper in its spirit is similar to [TT]. However, the main topic of 
this publication is different and devoted to the more narrow subject of the new 
synthesis of feedback stabilizers that minimize the semi-quadratic cost functional 
defined as 



This paper follows the same ideology as publications [7], [8], [9]. That means, 
we assume that the problem of optimal stabilization is solved locally in some 
small neighborhood of the target equilibrium. In the majority of real world 
applications that local solution is obtained in the framework of classical linear 
system theory [3]. Then we follow the ideas outlined in [7] and extend the 
optimal feedback outside the small neighborhood. This process can be inter- 
preted in optical terms: the stabilization problem in the reverse time can be 
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treated as a problem from the nonlinear optic with sources of "light" located 
on the level set of the " local" Lyapunov function. The propagation of " light" 
is described by projection into x-space the bicharacteristics of the Lagrangian 
manifold associated with the semi-quadratic functional. This scenario efficiently 
solves the problem of optimal stabilization. However, on this path we encounter 
the following pitfalls. The first is related to caustic phenomena. Our "light" 
propagates in non-uniform "media" (distortion is due to function s(x)) and we 
face scattering phenomena that leads to caustics. The second problem is related 
to the caustics. However, its true nature is not "scattering of light" but the sin- 
gularity of optimizers related, in particular, to those semi-quadratic functional 
where the matrix Q(x) is degenerate. Discussion of this problem for linear sys- 
tems can be found in [3] . To resolve the difficulties related to caustics we employ 
Maslov canonical operator. However, this approach does not solve completely 
the problems connected with singular optimizers, and this problem remains out 
of the scope of this publication. 



2 Preliminaries 

Consider a system 

x = f(x) + g(x)u (1) 

where u is the control input; x denotes the state of the system and x £ R n , R™ 
- 7i-dimensional linear real space. f(x), g(x) are vector fields: 

Vx £ R" f{x) £ R™ and g(x) £ R n 

and f(x), g(x) are infinitely many times continuously differcntiable with re- 
spect to x. We write /, g £ C°°. Throughout the paper we assume that 

/(0) = 

and R" is equipped with the scalar product and ||a;|| denotes the magnitude of 
x, i.e \\x\\ — y/ (x, x), where (x,x) is the scalar product of x with itself. 
Consider the optimization problem 



e(x) + (u,Q(x)u)dt -> inf (2) 
o 11 

subjected to the constraints 

i(t) = f(x)+g(x)u, 

(3) 

a; (t ) = x , 

where f,g £ C°° and u(t,x) is the feedback. We also assume that the function 
e(x) £ C°°, e(0) = and 

e(x) >0 Va;eR™\{0}. 
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Moreover, Q(x) € C°°, 

Q(x) = Q T {x) 

and 

(u,Q(x)u) >0Vti^0. 

The goal of this paper is the synthesis of the optimal feedback low 

u = u(t, x) (4) 

that solves the minimization problem and at the same time stabilizes the 
system ([1} at the origin over R™. Throughout the paper we assume that u(t,x) 
takes its values from R m . The stabilization is defined as follows. 

Definition 1 The system is said to be stabilizable by the feedback ^ if the 
solutions x(t,to,Xo) of the closed loop system |3J) satisfy the condition 

lim x(t, to,xo) = V xq € R™, to G R. 

t — >oo 

and the equilibrium is stable. 

Throughout the paper we assume that the system ([I]) is controllable on R" 
(see, e.g., [5]). 



3 Lagrange-Pontryagin's manifold 

Our main assumption is that the semi-quadratic stabilization problem stated 
in the previous section admits a local solution near the origin. For majority 
of practical applications this assumption is verified by means of classical linear 
theory applied to the linearization of the problem |T]), @ in the vicinity of the 
origin. Thus, we have a feedback w(x) and a Lyapunov function V(x) that are 
"good enough" in a neighborhood of the origin. In other words, there exists a 
positive number 5 such that 

{^-V(x), f(x) + w(x)b(x)) + (10(a), Q(x)w(x)) < V x e {V(x) = 6} (5) 
ox 

and the feedback w(x) solves our semi-quadratic stabilization problem in the 
neighborhood {V(x) < S}. 

Our main goal is to find the optimal feedback outside the neighborhood 

{V(x) < 5}. 

In order to do that consider the following optimization problem (with free end) 
B(x ) = inf{ ( e(x) + (u, Q{x)u)dt; V{x{T)) = 6} (6) 
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subordinated to constraints 

% = f(x) +g{x)u 

(7) 

x(0) = x . 

The function B(xo) is known as the Bellman function [lj. If we are able to 
construct the Bellman function B(x) outside the neighborhood 

{V(x) < 5} 

then our problem is essentially solved as long as the Bellman function is at 
least one time differentiable. In order to calculate B(x) we use the Pontryagin's 
maximum principle [lOj . 

Consider the Lagrange-Pontryagin's manifold defined by bicharacteristics 
(this terminology is borrowed from [5], [6]), the solutions of the hamiltonian 
system: 

d 

x = -—H(x,p), 



(8) 



^H(x,p), 



where H{x,p) is 



H(x,p)=s(x) + (pj(x)) - - A { Pl g{x)Q- l {x)g T {x)p). (9) 

All the bicharacteristics are emitted from the Lagrangian manifold associated 
with the level set 

{V{x) = 6}. 

In other words, the initial conditions for (|8|) are 

x(Q) = x , p(0) = X(x ) ■ ^V{x Q ) 

where xq G {V(x) = S} and X(xq) is such that 

H(x ,X(x )~V(x )) = 0. 

The existence of such X(xq) follows from ((5]). The union of all such bicharac- 
teristics for all points xo € {V{x) = 6} is the Lagrange-Pontryagin's manifold 
denoted in the sequel as A. 

It follows from Pontryagin's maximum principle that any optimal solution 
for the problem ([6]), ([7]) can be lifted to the Lagrange-Pontryagin's manifold A. 
Notice, that the singular optimizers are essentially eliminated by the inequality 
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(O and the assumption that the inverse Q~ 1 (x) exists for any x. However, 
"scattering of light" still remains as the cause of the problems related to the 
caustic phenomena. 

Let us introduce the natural projection P(x,p) = x, 

P : A — > R™. 

The Lagrange-Pontryagin's manifold admits a natural parametrization (t,£), 
where r is the parameter along the bicharacteristics and £ denotes (local) co- 
ordinates on the level set {V(a;) = S}. The set of critical values for the natural 
projection P is called caustic set or simply caustics. We denote the caustic set 
by dC. The Sard's theorem [5] implies that dC has zero Lebesgue measure in 
R". 

Now consider the function 

S(r,t) = - f(p,dx) (10) 
J-/ 

where 7 is the bicharacteristic connecting (0, £) and (r, £). 
Then the following statement takes place. 

Theorem 3.1 The Bellman function B{x) is defined as 

B(x) = M{S(t,0; (T,0eP-\x)}. (11) 

The derivative J^B(x) exists for any point x € R™ \ dC where the infimum 
3 re 

P^ 1 (x) \ (f, £). Moreover, 



is realized by a point (f, £) 6 P 1 {x) and S(t,£) < S(t,£) for all (r, £) £ 



H(x,^-B(x))=0. 



Proof. If (r,£) e P^ixo) then 



Slr.U - / 0^/.r) : - f T (p,^-H(x lP ))dt 



T 1 







ff(z,p)-£(a:) + -(p,5(a:)Q {x)p)dt 



and Pontryagin's maximum principle yields H(x,p) = 0. Hence, 

S(r,0 = £e(x) - ^(p,g(x)Q- 1 (x)g T (x)p)dt 
and applying once more Pontryagin's maximum principle yields 



mt 



T 



f{S(T,d); (t,0&P' 1 (x)}=M{ e(x) + (u,Q(x)u}dt; V(x(T))=S}. 
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That proves (fTTj) . 

Let xq £ R™ \ dC. If the infimum is realized by a point (f, £) 6 P _1 (a;o) and 
«S(f , £) < S(t, £) for all (r, £) 6 (f , £), then there exists a neighborhood 

D of (f,£) such that the natural projection P is a diffeomorphism between D 
and P{D). Hence, 

B{x) = S(r(x),ax)) 

where (r(a;),£(x)) denotes the smooth parametrization of D by x from P(D). 
That yields the existence of J^B(x). Finally, H(x,p) = on A, and consequently 

H(x,-^B(x))=0 

holds. 

Q.E.D. 

We call optimal control problem H]) Bellman-regular if for any £ the 
infimum (fTTj) is realized by a point (f,£) € P~ 1 (x) and <!)(•?,£) < S^r, £) for all 

(^)eP»\(f,a. 

For a Bellman-regular optimal control problem the derivative -^B(x) exists 
for any point x where the infimum pip is given by a non critical point of the 
natural projection P. Due to Sard's theorem [2] the Bellman function almost 
everywhere differentiable on R™ and consequently the optimal feedback 

u = -\-Q-\x)g T {x)^B{x) 

is defined almost everywhere on R™. However, for practical applications of con- 
trol theory the feedback has to be defined at each point from R". In order to 
achieve this goal we construct a regularization of the Bellman function near 
caustics with the ideas from Maslov canonical operator [5] , [6] . 

Let Cr{B) C A denote the set of critical points for P such that the infimum 
(jTTJ) is realized at each point from Cr(B). Evidently P(Cr(B)) is a subset of 
caustic dC where the Bellman function is not differentiable. 

4 Canonical Maslov Operator 

This section outlines the essential properties of the canonical Maslov operator 
that will be employed in our optimal feedback design. The reader interested in 
the details is directed to the publications [5], [B]. 

We outline the construction of canonical Maslov operator on a Lagrange 
manifold C. 

Consider a partition of set {1, 2, . . . , n} into two subsets a and /3 such that 
a n (3 = and aU/3 = {l, 2, n}. The linear space defined by coordinates 
(x a iPp) is called Lagrangian coordinate space (or Lagrangian coordinates) in 



G 



R^"p. It is known [5] that any point A £ £ has a neighborhood that can be 
parametrized by Lagrangian coordinates (x a ,pp) and the Jacobian 

in this neighborhood. 

There exists [5] the countable open cover for Lagrange manifold £, 

such that each fL admits Lagrangian coordinates (i a ,p^). Let {ej(A)}j be a 
partition of unity subordinate to the cover That means each ej(X) is an 

infinitely many times differentiable real function on C with compact support, 
supp(ej) C VLj. Moreover, each function takes non- negative real values and 

5>i(A) = l VAe£. (13) 



For each flj one can construct the generating function Sj(x a ,pp) where (x a ,pp) 
are the Lagrangian coordinates on ttj. The generating function Sj(x a ,pp) is 
defined as 



Sj(x a ,pp) = -(xp(x a ,pp),pp) + / (p,dx) 

J-y 

where 7 denotes the bicharacteristic connecting (0, £) and (r, £). 
Notice, that 

^■(z) = / {Pidx) 



when the local coordinates of Slj are equal x, a = {1, 2, . . . , n} and /? = 0. 

Consider a function <£>(A) such that supp(ip) C fX, and /3 7^ 0. Then one can 
define the sub-canonical Maslov operator Mask{$lj) as follows 

Mas fe (%)^= (-^-t)^ / J7 i e ifc ^(*«»*J') + < a '"W>V(a'a,P/9)dp/J, (14) 



where J, denotes the absolute value of the Jacobian (jl2[) and |/3| is the cardi- 



nality of the set /3; 



Jj -' d(r,0 1 (15) 



If /? = 0, then the sub-canonical Maslov operator Mask(Qj) is given by 

Mas k (n 3 )cp = J^e lks ^ x) ip(x), (16) 

where 

s j( x ) = / (j>,dx). 
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The canonical Maslov operator for C is constructed out of sub-canonical 
Maslov operators (fl~4"]) . (fl6)) . In order to do that, one needs to introduce the 
index 

i/{ilj,lL k ) = (idx( ) - idx( — ^— ^))(mod 4), 

where (x a ,pp) and (x&,p*) are coordinates of the same point A € Clj PI f2&; and 

dpp 

denotes the number of negative eigenvalues of 

dxp{x a ,pfj) 
dp/3 

If flj n ftk = 0, then index fife) is set to be equal to zero, 

v{Vtj, O fe ) = for % n fife = 0. 

Given a chain (fij , fi^, . . . , Slj k ) such that f2j s n fij s+1 ^ (for s taking 
values 0, . . . , k — 1) one can define the index 

fc-i 

i/(n i0) %, J J = (^K%>% s+1 ))(mod4). 

A chain (fL , f2j x , . . . , ftj k ) is called closed when fL- = S1 JA , . We say that 
Lagrange manifold C admits quantization if the following two conditions hold. 

i. For any closed curve (loop) 7 C C we have 

(p, dx) = 0. 



ii. For any closed chain (Qj , 0^, . . . , fij fc ) we have 

u(n jo , <> ; <>, : 0. 

It is shown in [6] that any simply-connected Lagrangian manifold admits quan- 
tization. 

Now we can introduce the canonical Maslov operator for Lagrange manifold 
L. If L admits quantization then the canonical Maslov operator Mask{C) is 
defined as 

Mas k {L)y = ^ • Afas fe (fl,)(e, .<p), <p e C°°(C), (17) 
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where ej-(A) is from (flU)) and Ma,Sk(£lj) is a subcanonical Maslov operator in- 
troduced by (fT4]) , (fT6|) . In order to define constants {cj} in (fl7)) we fix Slj with 
coordinates x and choose 

where vj denotes the index of a chain connecting flj with ttj . Due to quanti- 
zation of C the index Vj does not depend on the choice of the chain. It follows 
from [B] that 

Mas k {C) : C°°(C) - C°°(P(£)), 

where P denotes the natural projection P{x,p) = x. For the sake of convenience 
we will use Mask(C) instead of Mask(C)l. 

5 Asymptotics of optimal feedback 

We assume that the control problem @, |T]) is Bellman-regular. In order to 
create a regularization for Bellman function we take a countable cover of 
Cr(B) such that every Slj has Lagrangian coordinates {x aj iPf)j)- Moreover, if 
a point (f, £) £ Cr(B) belongs to ttj then 

o i n(p- 1 (P(r,|))\(f,e)) = 0. 

The existence of such cover follows from [6]. Let us assume that every 
connected component Cg of 

Uji~lj = Ug£,£ 

is a Lagrangian manifold that admits quantization. Then we have smooth func- 
tions {Mask(Ce)} defined on each {P(£^)}, respectively. Now consider a count- 
able family of open sets 

K x m Efi) = {\\x- x^W < Sf,}, d(x^ ^) = {||a; -x ll \\> ^} 

such that 

P(Cr(B)) C U M &(*/«, e M ), P(A) C U,, (&(*„, £„) U d(^, ^)) 

and each x^ £ P(Cr(B)). Moreover, the real numbers {s^} are chosen so that 
for each /z one can find j such that 

and flj has Lagrangian coordinates. 

The cover evidently exists (see, e.g. [2]). Consider partition of unity {w^, v^} 
subordinate to cover 

where {u> M , f^} are infinitely differentiable non-negative functions with compact 
supports, 

supp(w^) C 6(a; M ,£ Al ), supp{v^) C cZ(x M , -^) 
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and 

X)K + «/*) = ! V xeR". 
We propose the following regularization for the Bellman function 
B(x,k) = B(x)-(^v^)-Re{Y / T^—HMas k (C j ))}-( ]T «;„), 

M j a; t ,eP(Cr(B)n£ 3 -) 

where i = y— T; ln(z) is a fixed branch of the complex logarithm; Re(a + ib) = 
a: B(x) denotes the Bellman function constructed in We show that 

B(x, k) — ► B(x) as fc — > oo 

uniformly on any compact set -ftT in C^-topology. Indeed, 

B(x) = B(x, k) for x £ \J x ^ P(Cr(B)) b{x^, e M ). 

A compact intersects only a finite number of balls {b(x^, e^)} and we need 
to prove uniform convergence on closure of each ball. The latter follows from 
the theory of semi-classical asymptotics [6]. Since 

the corresponding function Mask(Cj) takes form 

Mas^) = (-^)^ I j-i e ik(s^ a , P ,)+{^p ff )) dp0 V xebix^En), 
-'R.p (3 

where Jj is defined in (fT5| . The method of stationary phase (see, e.g. [?]) yields 

Mas k {C 1 ) = C r jp .\^l\-h- lk - poB(x) +0(~) as k ^ oo 
J opp k 

where Cj is a constant. This asymptotic can be differentiated and the conver- 
gence is uniform with respect to x. Hence, 

— — InfMasJCj)) = -B{x) +0(h as k -> oo (18) 
ik ■ po k 

Thus, we justified the convergence 

B(x,k) -► B(x) 

in C 1 - topology over any compact K. 

By construction J5fc(x, A:) is differentiable at any point x, and therefore, can 
be used for feedback design instead of B(x). Our "semi-classical" feedback 

u = -yQ- 1 (x)g T {x)^-B(x,k) 



10 



is equal to the original optimal feedback 



u = - l --Q-\x)g T {x)-^B{x) 



everywhere outside an {e p }-neighborhood of P(Cr(B)) and the neighborhood 
can be made as small as necessary for a particular application. 

The feedback low can be designed in the same way as it was done in [7] , [8] , 

m 



u(x) 



w(x) for x G {V(x) < 5} 

-\ ■ Q- 1 (x)g T (x)£B(x, k) for x G {V(x) > 6} 

where w(x) and V(x) are defined in ([5]). 

We summarize the discussion of this section in the form of the following 
theorem. 

Theorem 5.1 Consider Bellman-regular control problem (Qp, (0) that admits 
optimal solution for its linearization 

x = Ax + Bu, / (x, —, T e(0)x)+ < u, Q(0)u > dt — > inf 
J Q dx z u 

where e(0) = 0, ^e(O) = and -g^eifi) denotes the Hessian of the function e(x) 
(in this context (x, J^2e(0)x) is strictly positive quadratic form); A = gj:/(0) 
and B — -^g(0). Then there exists the Bellman function B(x) G C°°(R n \ 
P(Cr(B))) and B{x) is at least one time continuously differ entiable in a neigh- 
borhood of any point from P{Cr{B)). 

Proof. Since the control problem (JTJ) , Q admits optimal solution for its 
linearization we have a linear feedback w{x) and a quadratic Bellman function 
W(x) for the linearization of the problem. Moreover, there exists a positive 
number S such that 

(-^-W(x),f(x) + w(x)b(x)) + (w(x),Q(x)w(x)) < V x G {W(x) = 6}. (19) 
ox 

Making use of Theorem 13. II yields the existence of the Bellman function B$(x) 
outside the neighborhood 

{W(x) < 5} 

such that 

^B s (x) = p V x G P(A S ) \ P(Cr(B s )) 

where (x,p) belongs to Lagrange-Pontryagin's manifold As, where S is from (|19p . 
Lagrange-Pontryagin's manifold is continuously differentiablc infinitely many 
times then so is the Bellman function B$(x) for all x £ P(As) \ P(Cr(Bs)) and 
x ^ 0. 
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If x G P(Cr(Bs)) then one can construct C°°-appi'oximation (fT5|) for Bg(x) 
with the help of the canonical Maslov operator. This approximation converges 
uniformly in C^-topology to B$(x). Hence, B$(x) is at least one time continu- 
ously differentiable at x G P(Cr(Bs)). 

Taking the limit 5 — > yields that the Bellman function 

B(x) = lim B s (x). 

That justifies the assertion of the theorem and the proof is completed. 
Q.E.D. 
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